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Abstract. We shall show that a two-parameter extended entropy function is characterized 
by a functional equation. As a corollary of this result, we obtain that the Tsallis entropy function 
is characterized by a functional equation, which is a different form used in [I] i.e., in Proposition 
On 12.11 in the present paper. We also give an interpretation of the functional equation giving the 

Tsallis entropy function, in the relation with two non-additive properties. 
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O ! 1 Introduction 

as 

', Recently, generalized entropies have been studied from the mathematical point of view. The 

typical generalizations of Shannon entropy [2] are Renyi entropy [3] and Tsallis entropy [3] . The 
' Renyi entropy and the Tsallis entropy are defined by 
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(A) = - logVx^, {q^l,q>0) 
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for a given information source X = {xi, ■ ■ ■ ,x„} with the probability pj = Pr{X = xj). Both 
entropies recover Shannon entropy: 

n 

Si{X) = - log pj 
i=i 

in the limit g — )■ 1. The uniqueness theorem for the Tsallis entropy was firstly given in [5] and 
improved in [6]. 

Throughout this paper, a parametric extended entropy such as Renyi entropy and Tsallis 
entropy and so on, is called by a generalized entropy. 
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We note that the Renyi entropy has the additivity: 



R,{X^Y)=R,{X) + R,{Y) 

but the Tsahis entropy has the non-additivity: 

S,{X xY) = SgiX) + Sg(Y) + (1 - q)Sg{X)S,iY), (1) 

where X x Y means that X and Y are independent random variables. Therefore we have a 
definitive difference for these entropies, although we have the simple relation between them: 

R<iiX) = Y^log{l + {l-q)S,{X)}, {q^l). 

The Tsallis entropy is rewritten by 



n 



S,{X) = -}_^p'jln,p, (2) 

i=i 

where the g-logarithmic function is defined by 

— 1 

lngX = — , 

1 - q 

which uniformly converges to logx in the limit q 1. 

Since Shannon entropy can be regarded as the expectation value for each value — log pj , we 
may consider that the Tsallis entropy can be regarded as the g-expectation value for each value 
— lug Pj , as an anology to Shannon entropy. Where g-expectation value Eg is defined by 

n 



Eg{X)^^p% 



i=i 

However, the (/-expectation value Eg lacks the fundamental property such as E{1) = 1, so that 
it was considered to be inadequate to adopt as a generalized definition of the usual expectation 
value. Then the noremalized g-expectation value was introduced: 

En q 

and by using this, the normalized Tsallis entropy was defined by 

■^9 l-^J - v=^n -a- ^ -fl 1 \<1T 

l^j=lPj Z^i=lPi 

We easily find that we have the following non-additivity relation for the normalized Tsallis 
entropy: 

X y) = s^^°'\x) + + {q- i)5j"°'^)(x)5("°'')(y). (3) 

As for the details on the mathematical properties of the normalized Tsallis entropy, see |7j for 
example. The difference between two non-additivities Eq.([T]) and Eq.([3]) is the signature of the 
coefficient 1 — g in the third term of the right hand sides. 
We note that the Tsallis entropy is also rewritten by 

n 

Sg{X) = Y,P,\ng- (4) 
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, where Ei means 



so that we may regard it as the expectation value such as Sq{X) = Ei 
the usual expectation value. However, if we adopt this formulation in the definition of the Tsallis 
conditional entropy, we do not have an important property such as a chain rule. (See [8] for 
details.) Therefore we often adopt the formulation using the (^-expectation value. 

As a further generalization, for two positive numbers a and /3, a two-parameter extended 
entropy: 

x"^ — 

has been studied in many literatures P fTUl fTTl fT^ [TBI fM fTC] . 

In the paper [1], a characterization of the Tsallis entropy function was proven by using the 
functional equation. In this paper, we shall show that the two-parameter extended entropy 
function is characterized by the functional equation. 



2 A review of the characterization of TsaUis entropy function 
by the functional equation 

The following proposition was originally given in [T] by the simple and elegant proof. Here we 
give the alternative proof along to the proof given in |16j . 

Proposition 2.1 (jl]) 7/ the dijjerentiable nonnegative function fq with positive parameter q G 
M satisfies the following functional equation: 

fq{xy) + fq{{l-x)y)- fq{y) = {fq{x) + fq{l-x))y\ (0<x<l, 0<y<l) (5) 

then the function fq is uniquely given by 

fq{x) = -CqX'^lUqX, 

where Cq is a nonnegative constant depending only on the parameter q. 
Proof. 

If we put y = 1 in Eq.([5]), then we have fq{l) = 0. From here we assume y I. We also put 
gg{t) = Then we have 

xgq{xy) + (1 - x)gq{{l - x)y) - gq{y) = {xgq{x) + (1 - x)gq{l - x)) y''~^ (6) 

Putting X = I in ([6]), we have 

^'^ (I) " (0 ^"'^ ^ 

Substituting | into y, we have 

By repeating similar substitutions, we have 
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Then we have 

lini ^ii^ = (7) 
due to g > 0. Differentiating Eq.Q by y, we have 

x^9g{xy) + (1 - xfg^iil - x)y) - g'g{y) = {q - 1) {xgg{x) + (1 - x)gq{l - x)) y'?-^ 
Putting y = 1 in the above equation, we have 

x^g'gix) + (1 - xfg'gil -x) + il-q) (xgg^x) + (1 - x)ggil - x)) = -Cg, (8) 
where Cg = -g'g{l). 

By integrating the equation ([6]) from to 1 with respect to y and performing the conversion 
of the variables, we have 

i-l—x rl 2~Q^ 

gg{t)dt+ 9q{t)dt- gg{t)dt = {xgg{x) + [l - x)gg{l - x)) . (9) 

By differentiating the above equation with respect to x, we have 

gg{x) - 2-%(2-^x) - 5,(1 -x) + 2-%(2-^(l - x)) 
I _ 2-1^ 

= {gq{x) + xg'g{x) - gg{l - x) - (1 - x)g'g{l - x)) . 

Taking the limit — )• oo in the above, we have 

(1 - x)gg{x) + (1 - q)gg{l -x) = xg'g{x) + (1 - q)gg{x) (10) 
thanks to ([7]). Prom the equations ([8]) and (llOp . we have the following differential equation: 

xg'g{x) + (1 - q)gq{x) = -Cg. 

This differential equation has the following general solution: 

ggix) = -r^+dgX'^-\ 

where dg is a integral constant depending on q. Prom gg{l) = 0, we have dg = Thus we 
have 

xi-^ — 1 

9qix) = Cg— . 

I — q 

Pinally we have 

fq{x) = Cg- = -CgX'^lxiqX. 

Prom fg{x) > 0, we have Cg > 0. 

■ 

If we take the limit as q 1 in Theorem 12 .H we have the following corollary. 

Corollary 2.2 ( |16| ) // the differentiable nonnegative function f satisfies the following func- 
tional equation: 

f{xy) + f{{l-x)y)-f{y) = {f{x) + f{l-x))y, (0 < x < 1, < y < 1) (11) 
then the function f is uniquely given by 

f{x) = — cxlogx, 

where c is a nonnegative constant. 
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3 Main results 



In this section, we give a characterization of a two-parameter extended entropy function by the 
functional equation. Before we give our main theorem, we review the following result given by 
Pl.Kannappan [17\\T8\. 

Proposition 3.1 ( [17\ I18| ) Let two probability distributions {pi, ■ ■ ■ ,Pn) and {qi, ■ ■ ■ ,qm)- If 
the measureable function / : (0, 1) — > M satisfies 

n m n m m n 

E E f{p^<l,) = Y.p?Il + E E f(p^)' (12) 

2=1 j=l i=l j=l j=l i=l 

for all (pi, • • • ,Pn) and (gi, • • • , Qm), then the function f is given by 

( c{p''-p^), 
/(p) = < cp^logp, a = /3, 

[ cplogp + b {mn — m — n) p + b, a = 13 = 1. 

where c and b are arbitrary constants. 

In the following theorem, we adopt a simpler condition than Eq. (jl2p . 



Theorem 3.2 // the differentiable nonnegative function fa^p with two positive parameters a,l3 (z 
M satisfies the following functional equation: 

faA^y) = x'^faAv) + {0 < X,y < 1) (13) 

then the function fa^fi is uniquely given by 

3 a 

and 

faix) = -CaX" log X, {a = /3) 

where Ca^p and Ca are nonnegative constants depending only on the parameters a (and 13). 
Proof. 

If we put y = 1, then we have fa,p{^) = due to x > 0. By differentiating Eq. (fT3]) with 
respect to y, we have 

x4^(xy) = x^f'^Av) + (14) 
Putting y = 1 in Eq. (|14p . we have the following differential equation: 

Xf'a,f}{^) - l^faA^) = -Ca,/32;", (15) 

where we put Ca,^ = — jsi^)- Eq.([T5]) can be deformed as follows. 

X^+l [x-^faAx))' = -Ca,^x''- 

That is, we have, 

[x''^fa,l3ix)^ = -Ca^jBi 
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Integrating both sides on the above equation with respect to x, we have 

x-^UA^) = -^x"-^ + d^,p, 

where da^/s is a integral constant depending on a and (3. Therefore we have 

a — p 

By /a,;3(l) = 0, we have da,i3 = Thus we have 



a-/3 

Also by fa,p{x) > 0, we have Ca^p > 0. 

As for the case of a = /3, we can prove by the similar way. 

■ 

If we take a = g, /3 = 1 ora = 1, f3 = q in Theorem 13.2^ we have the following corollary. 

Corollary 3.3 If the dijferentiable nonnegative function fq with a positive parameter q G M 
satisfies the following functional equation: 

fg{xy) = x'^fg{y) + yfq{x), {0<x,y<l, q ^ I) (16) 

then the function fq is uniquely given by 

fq{x) = -CqX'^lD.qX 

where Cq is a nonnegative constant depending only on the parameter q. 

Here we give an interpretation of the functional equation (jl6p from the view of Tsallis 
statistics. 



Remark 3.4 Replacing x by y each other in Eg. p6\) and summing two functional equations, 
we have 

/.(^y) = (^^) /.(y) + /.(^), {0<x,y<l, qy^l). (17) 

Then the functional equation (7?) can be regarded as the sum of two following functional equa- 
tions: 

fgixy) = yfg{x) + xfq{y) + (1 - q)fq{x)fq{y) (18) 
fg{xy) = yifqix) + xifq{y) + {q - l)fq{x)fq{y) (19) 



Two equations and \19^) imply the following equations for i = 1, ■ ■ ■ ,n and j = 1, ■ ■ ■ ,m. 

fq{XiVj) = VjfqiXi) + Xifqiyj) + (1 - q) fq{Xi) fq{y j) (20) 
fq{XiVj) = VjfqiXi) + xjfqiyj) + {q - l)fq{Xi)fq{yj) (21) 



Taking the sum for Eq. h20\l and Eq. \21\l on i and j with simple calculations, we have two non- 
additivity relations given in Eq. (OP and Eq. where we put Cq = 1 for a simplicity. Therefore 
we can conclude that two functional equations il8\) and il9\) . which are the essential parts of the 
non-additivity relations Eq.^^ and Eq.^, characterize the Tsallis entropy function. In other 
words, the Tsallis entropy function can be characterized by two non-additivity relations Eq.^^ 
and Eq.^. 
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If we again take the limit as g ^ 1 in Corollary 13.31 we have the following corollary. 

Corollary 3.5 // the differentiable nonnegative function f satisfies the following functional 
equation: 

f{xy)=yf{x)+xf{y), {0 < x,y < 1) (22) 
then the function f is uniquely given by 

f{x) = — cxlogx 

where c is a nonnegative constant. 
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